I have been asked before by those that may/may not know I don't attend the meetings, "How's the congregation?"
Sometimes I say, "Great!" (My wife attends and doesn't seem to complain. So I use her opinion as my answer.)
Or I say that I currently don't attend and don't care to discuss it.
Another thing that I have said is that I am taking time to be honest with myself. And if the end comes (I don't believe in "the end" but it is language the JWs understand), I would rather be judged for being honest and 'inactive' in the org rather than hypocritical and active.
That has stopped several people from questioning any further. Pretty damn honest and straightforward in my opinion.